🕷️️ Job Radar • SCRAPING

freelancer.com 🟢 2026-05-02

🔹 Scrape Xing User Profiles
👤 Client: 🇦🇹 St.Pölten, Austria Member since 2015-12-26
💰 Price: $162 Average bid
🚩 Problem: Extract contact information from Xing user profiles while adhering to scraping best practices.
📦 Existing: Not specified

Specifications:

[Target] Extract full name, job title, company, email, phone, and profile URL from Xing user profiles.
[Method] Develop a Python-based scraper using libraries like Beautiful Soup or Scrapy. Ensure compliance with Xing’s terms of service by respecting rate limits and anti-bot measures.
[UI/UX] Not applicable
[Stack] Python, BeautifulSoup, Scrapy, Pandas, Requests, CSV
[Security] Implement error logging for interrupted runs and include simple resume capability. Ensure data privacy and security in handling scraped information.
[Format] Deliver a well-structured CSV file with clearly labeled columns: full name, job title, company, email, phone, profile URL.

Workflow:

1. Research Xing’s API or terms of service to understand scraping limitations and best practices.
2. Develop the scraper using Python with libraries like BeautifulSoup or Scrapy for efficient data extraction.
3. Implement rate limiting and anti-bot measures to avoid detection by Xing’s systems.
4. Test the scraper on a small set of profiles to ensure accurate data capture.
5. Refine the script based on testing results, ensuring all required fields are captured accurately.
6. Use Pandas to compile the extracted data into a clean CSV file with properly labeled columns.
7. Write detailed setup instructions and include any necessary dependencies for future execution.